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ABSTRACT 

A study established the logical validity of 
instructional activities for teaching reading evaluatively. These 
activities operationalized a theory of literacy and a aodel of 
reading comprehension developed by L. Dagostino and J. Carifio that 
specify 20 general characteristics of literate students who read 
evaluatively. Nineteen secondary classrooa teachers were randomly 
assigned three characteristics for which they were to construct two 
instructional activities each. The 114 activities constructed were 
then randoaly assigned to the 19 teachers to assess the degree to 
which the activities logically reflected the characteristic for which 
they were constructed. In teras of the instructional activities, all 
3 judges agreed that 66 (582) of the activities reflected the 
characteristics and 2 of the 3 judges agreed that 108 (952) of the 
activities reflected the characteristics. These results supported the 
view that these 20 characteristics can be translated into valid 
instructional activities by experienced classrooa teachers. (Three 
tables of data are included.) (Author/RS) 
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Establishing Tha Logical Validity of Instructional Activities 
For Teaching Evading Evaluatlvely 



Abstract 

This study established the logical validity of instructional activities for 
teaching reading evaluatively. These activities operationalized a theory of 
literacy and model of reading comprehension developed by Dagostino and 
Carifio (1993) that specify 20 general characteristics of literate students who 
read evaluatlvely, 

Nineteen classroom teachers were randomly assigned 3 characteristics 
for which they were to construct 2 instructional activities each. The 114 
activities constructed were then randomly assigned to the 19 teachers to 
assess the degree to which the activities logically reflected the 
characteristic for which they were constructed. 

In terms of the instructional activities, all 3 Judges agreed that 66 of 
114 (58*) of the activities reflected the characteristics and 2 of 3 Judges 
agreed that 108 of 114 (95*) of the activities reflected the characteristics. 

These results supported the view that these 20 characteristics can be 
translated into valid instructional activities by experienced classroom 
teachers 
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The present study sought to establish the log leal validity 
of instructional activities for teaching reading evaluatlvely. 
The construct of reading evaluatlvely used in this study 
was derived from a theory of literacy and a model of 
reading comprehension based on a cognitive point of view 
and its logical implications for instruction of higher-order 
cognitive abilities (Dagostino and Carifio, in press). Aspects 
of this theory and model are presented below. 

This paper presents the background for the present 
study, descriptions of the categories used to classify the 
instructional activities, a description of the procedures for 
collecting data, and a summary of the results and 
implications of the findings. The results of the present 
study not only have direct instructional implications, 
but also provide a general model of how theory may be 

translated into dirtct instructional practices in a validated 

and systematic fashion. 

Background 

Reading evaluatlvely is a major component of a model of 
reading comprehension developed by Dagostino and Carifio 
(in press). Including such a component in a model of reading 
comprehension necessitated delineating the construct of 
reading evaluatlvely and testing its validity. Of particular 



interest to the researchers was an application of the 
construct to instruction. This interest and focus led to 
the development of twenty general characteristics that we 
hypothesised constituted reading evaluatively. Each of these 
general characteristics we hypothesized could be translated 
into instructional activities by classroom teachers. 
ASDtCtS Of a Thtorv of Literacy and A Modg] Beading 
Comnr»h»nit<nn 

The theory of literacy underlying the model of reading 
comprehension in this study emphasizes the idea of 
multiple proficiencies, and represents those proficiencies 
through four spheres of literacy. The four spheres of 
literacy are (i) functional literacy, (2) specialized literacy, 
(3) cultural and multicultural literacy, and (4) critical 
literacy. This view of literacy models the changing needs 
and expectations of different environments and kinds of 
literacy. It recognises the multiple kinds of literacy 
represented in the literature and the potential relationships 
between and among the spheres. Most Importantly, this 
theory of literacy emphasises the ability to evaluate 
critically what is read. Regardless of the sphere or spheres 
of literacy, a reader finds that simply attaining basic 
comprehension is not enough for living In today's world. 



Developing a theory of literacy with evaluation as a 
driving force led us to develop a comprehensive model of 
reading comprehension that also focused on processes of 
evaluation. Thl3 model of reading comprehension is 
organized around the principle that the process of evaluation 
is used continuously throughout the reader-text interaction. 
This view means that evaluation of a text Is a part of the 
process, as well as the reader's response to what is 
comprehended and represented in an Interpretation of the 
text. Also Important to this model Is the idea that a reader's 
evaluation of a text may vary with (1) the degree of 
objectivity and emotional distance maintained by the 
reader, (2) the stringency of any application of criteria, and 
(3) the latitude of selected criteria. These three decisions, 
in turn, influence the nature of the continuous interaction. 

This idea of continuous interaction throughout the reader - 
text interaction contrasts with the strict sequential, and 
hierarchical view of reading comprehension that 
suggests a direct progression from literal to inferential 
understanding, and then to evaluation in step-like levels. 
The inclusion of evaluation as a continuous interaction in 
reading comprehension also differs from other interactive 
models of reading comprehension that focus on literal and 



inferential comprehension. The view that the evaluation of 
text occurs continuously may be derived from a cognitive 
view of information-processing and learning (see Dagostino 
and Carifio for details, in press). 

The model we have proposed establishes an evaluation 
component in reading comprehension that needs to be more 
clearly delineated so that we can know what constitutes 
the evaluation process and how well synthesized it is. We 
have proposed general characteristics that may constitute 
the process of evaluation. The question addressed by the 
present study is How well can these proposed characteristics 
be translated into instruction? 

Description of the Characteristics of Baadine Evaluatlvely 

The twenty general characteristics of reading evaluatlvely 
which were being tested for their logical validity ere 
listed and described below. 

1. Header' s General Approach Tn T»»t- The reader's approach 
to text includes activating prior knowledge, ensuring 
openness to the author's message, stating the reader's 
knowledge and beliefs, and testing the message against 
experiences, logic and other sources. 

2. Beading For Intention ana Assumaitoiis; This 

characteristic of reading evaluatively means comprehending 

- 4 - 



explicit and implicit messages *nd testing the plausibility 
of the reader's conclusions. Part of determining explicit and 
implicit messages means ascertaining the writer's 
assumptions about the topic and generating other possible 
assumptions either complementary or contradictory. 
3. Reading Different Kind* of M a terial tvaluatlwly This 
characteristic of reading evaluatively entails understanding 
how the reading process is transformed for poetry, 
exposition, narrative and argumentation by using specific 
criteria for formal evaluation. 

4- Establishing Elirjmax In P»»din T EgalUAiiSEglYJ This 
characteristic entails establishing purposes beyond getting 
literal and basic inferential meaning. Instead the reader 
focuses on getting at underlying intentions, assumptions 
and a@mi. 

*• Te^ iina Bow T« ftxad y ntr a Point Qf Vl g ~ TnU 
characteristic entails understanding that a point of view 
represents and interprets events differently. This is true in 
fiction as well as non-fiction although it takes slightly 
different forms. 

6. Dftgrminlne Attitude Tnw» M jgpjtingj A reader must 
recognise how sbe feels about a topic, types of material, 
styles of writing, specific points of view because attitude 
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determines how you interact with the Ideas and the message 
and your level of disagreement. 

7. Sorting Personal P»*iin« Emm Anniir.Unn nf EKltgnaJ 

CritfTla: A reader needs to know how emotional 
responses differ from Intellectual responses hy Identifying the 
"criteria" of emotional response and the "criteria" of 
objectivity. 

t. Constructing A Pni nt Of Vi»w A reader needs to 
understand how having a point of view logically leads you 
to certain actions and reactions. 

*• Drawing Conclusion*. *M»±i* f P™dictinn« njul aumndiBI 

Judgment Thrmith Maintaining imut totBiai had 

HYPPthtala-Tgatlni: This characteristic of reading 
evaluatlvely is an information-gathering process that 
requires the reader to bring details to closure periodically, 
to withold personal Judgment and set the direction for 
thinking that predicts what will occur. Logic and 
information must direct the predictions and the final 
conclusions for plausible endings to be legitimized. 
10. T a t HftfiU Qf Interpretation A» A Pj^ilminhqe fftgp 

To Evaluation: This characteristic requires 
understanding how multiple Interpretation help create the 
openness to message necessary for evaluative reading. 

- » - 
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Seeing that interpretation influences bow external criteria 
are applied and accepted. 

11. Integrating The B^der's Egrannal W w » W»h Th e Yfr w « 
Off The Larger World : A reader's personal views may be 
limited or misconceived in relationship to the views of the 
world at large. This characteristic focuses on the need to 
match schemas and synthesize them based upon multiple 
views. 

12 - tfnderstandiBK That Reading gojapxehgnaiaa t » , pgasgaa 

Qj gathering, assimilating- thinkiBg »nd restructur in g; 
A reader views reading comprehension as an interactive 
process where the reader uses skills and strategies to find 
explicit and implicit meaning. The reader is thinking about 
meaning and how he arrived at it so that an appropriate 
response can be made. This means using 1) determining 
importance of information 2)summarizing text, 3) drawing 
inferences, 4) generating questions and 5) monitoring 
comprehension for achieving a mature response. 
13 * Establishing BgajixXsJ fiflkla; Several questions help the 
reader determine the author's perspective. These questions 
are: 1) What is the author's point of view? 2J How does she 
establish it? and 3) What is her purpose? A reader always 
aims to determine what the writer has to say. Understanding 
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tli« author's point of view -od purpose leads to making « 
reasonable interpretation of text. Recognizing now the writer 
Accomplishes his goal helps the reader evaluate the message. 
Once purpose and point of view are established a response 
can be made. 

14 ' P**«ctlng Inception; mis facet of reading evaluatlvely 
focuses on recognizing propaganda and whether it sells 
something or someone of value. When the purpose is to 
persuade the reader must recognise the writer's slant of 
information and ideas. The reader must recognize the 
situational purpose of a text and weigh the message and the 
presentation. 

15 ' Set t ing CrrtiMHtY nni l Ynll il lty This dimension of 
reading evaluatlvely focuses on distinguishing Fantasy from 
Renllty and distinguishing Fact from Opinion on the bases of 
authenticity, adequacy and relevance as well as on following 
end evaluating logic and argument. It also entails recognizing 
the influence of beliefs and attitudes which are part of a 
person's moral structures and knowing what to believe or to 
do is based upon the reader's ability to find the logic and 
truth in the text. Doing this means determining the truth 
unbiased by moral views of an Issue. Readers are looking for 
plausibility and possibility of occurrence of events as well as 



internal validity. 

1». Developing Sensitivity to t»n T .. M >- This aspect of 
reading evaluatively is focused on Diction, Denotation and 
Connotation, Tone, Figurative Language, and Use of Syntax. 
Readers must become sensitive to the framing of a 
message and what words are chosen to create a particular 
tone. Additional features are use of formal or informal 
register, use of symbolic or abstract language, and overall 
effect of phrasing and sentence structure. 
47 • Bulldine gJittWisiUt This aspect of reading 

evaluatively focuses on building general knowledge as well as 
specific schema for different established bodies of knowledge 
on different topics. It also entails building points of 
comparison to test ideas in text and building bases for 
assimilation and accomodation of new information and ideas. 
18 • Developing Schema For B.fl.r Hv. Q.„«Hnn tnf • Readers 
must learn to monitor comprehension by questioning 
thtmsclvts and the text in a reflective manner. 
19 • Achieving Automatlcltv Of jflajyolsj Readers must 
automate all of the skills and strategies they have developed 
so that analysis and evaluation are assimilated in the reading 
habits and process they take to text. 

20 • Generating Response To T»tU» Tiii« dimension of reading 

- 9 - 
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evaluatively focuses on a reader's response to text beyond 
basic literal and inferential comprcbension. 

As previously stated, reading evaluatively is a major 
component of reading comprehension. The twenty general 
characteristics of reading evaluatively described above 
were derived from a theory of literacy and a model of 
reading comprehension based on a cognitive point of view. 
Our efforts to delineate these characteristics and test them 
for logical validity should help determine if reading 
evaluatively is a clearly distinguishable set 
of characteristics that can be translated into individual 
Instructional activities or a syntheslied ability, in either 
case, our findings are informative on several points, and 
•hould prove useful for instruotion of reading 
evaluatively as an Integral part of reading comprehension. 

The present study does not address Instructional sequencing 
issues or whether our construct is appropriate for a specific 
•ge group or for all learners. The instructional activities that 
were developed In the present study were created with 
secondary school students in mind as a 'baseline*. They may 
be appropriate, with or without modification, for learners in 
other age groups. 
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The general model and methodology used in this study is 
an adaptation of Campbell and Flake's (1959) convergent and 
discriminant validity paradigm. This paradigm Is something 
called the method of "congruence" (Kerllnger, 1986), the 
method of "trlangulatlon" (Borg and Gall, 1989), or a "panel- 
design (Lama and Carlflo, 1992). In general, the focus on this 
method Is to have someone generate an Item (Instructional 
activity) that Is suppose to operationally and reflect some 
objective specification (l.e, characteristic of reading 
evaluatlvely) and then have some other Independent Judge 
rate whether the Item corresponds and logically reflects the 
objective specification. This basic design or model is 
strengthened through replication which is considered by 
most researchers to be the second basic cannon of 
experimentation after randomisation. Consequently, one 
would have at least two Judges rate the item (instructional 
activity) produced according to the objective specification. 
If the two Judges agreed that the item (Instructional activity) 
reflected the specification then their Judgments would 
"converge" or be "congruent" and this (intersubjective 
agreement) would be evidence for the item's logical validity; 
namely, that the item reflected what It claimed 
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to reflect. This basic model and logic not only supports the 
logical validity of tbe instructional activities written, but 
also is strong evidence for the specifications being relatively 
clear and precise enough for independent writers to create 
equivalent activities using them. This latter point is a point 
tbat is often missed in tbe interpretation of outcomes of this 
design. 

Multiple writers devising "logically equivalent" 
instructional activities, therefore, is strong empirical 
evidence for both the objective quality of the criterion 
specification and the discriminabllity of one criterion 
(characteristic of reading evaluatively) from another. Such 
an outcome would also mean that valid instructional 
activities could be readily and routinely created for each 
characteristic of reading evaluatively, provided that 
practicing classroom teachers were used to write the 
instructional activities. Using tbe same classroom teachers 
to rate the instructional activities written, moreover, 
would be strong evidence for the quality and the 
discriminabllity of the specifications of each characteristic 
of reading evaluatively. It was for this later reason that 
practicing classroom teachers were used in the present study. 



9 

ERIC 



- 12 - 



* t* 

.1U 



M«thodnln TY 

The instructional activities that were to be evaluated 
were generated by 19 classroom teachers in a graduate course 
in Developmental Reading for the Secondary School. The 
activities were developed after the teachers discussed each 
characteristic and after they had reviewed sample activities 
developed by the researchers. The discussion was the focus 
of a two hour class session. 

The activities that were developed were general guidelines 
for how to teach one of the twenty characteristics described 
earlier in this paper. For the most part, the guidelines 
helped teachers lead students through a step by step process 
of instruction. Each activity was designed to be used with a 
number of texts rather than one specific book or passage, 
thus making them useful for more than one lesson. The 
descriptions of the instructional activities were 
approximately one-half to one typewritten page in length. 
They were not lengthy lesson plans. 

To develop the instructional activities, each classroom 
teacher (n-19) was randomly assigned 3 characteristics, 
and then was asked to develop and write out 2 instructional 
activities for each characteristic assigned for a total of 6 
instructional activities per teacher. These classroom teachers 

- IS - 



were given on* wttk to create tho activities. 

Tho If classroom teachers in this study generated a total of 
114 instructional activities. Once the 114 instructional 
activities were developed, they were packaged for a blind 
review by the same 19 classroom teachers. The reviews were 
done four weeks after the activities were developed. Each 
reviewer's packet contained 18 instructional activities to rate 
that were randomly assigned to each reviewer, excluding a 
given reviewer's own activities. 

Each instructional activity was evaluated by at least 3 
reviewers. Each packet of instructional activities had (1) a 
cover sheet with directions, (2) a rating sheet with th* 
rater's code number and spaces for the reviewer's responses 
to each of 18 activities, (3) 18 instructional activities to be 
rated and (4) a list of the characteristics of reading 
evaluatively. 

The reviewers were instructed orally and in writing to 
read each activity to determine if the activity represented 
the characteristic it was said to represent. In terms of 
making this congruence Judgment, the reviewer could respond 
"yea, not completely, or no". If the reviewer thought the 
activity did not represent the stated characteristic (i.e., 
responded no or not completely), s/he was asked to explain 
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why not. 

The reviewers also were asked to identify other 
characteristics the activity might represent as an indirect 
measure of each characteristic's discriminability. 
Clarification of instructions was given to entire group where 
needed. The time allotted to performing these ratings was 2 
hours. The reviewers worked independently in the same 
room. They could take breaks, but they could not discuss 
their judgments. This rating task was done as an activity 
in a graduate class, and it represented an application of 
concepts related to reading evaluatively. When the reviewers 
completed their work, graduate assistants keyed the 
reviewer's responses into a computer file so that the data 
could be analyzed. 
Results 

The first question that was addressed was, 
"What is the inter-rater agreement when all Judges and all 
activities are analyzed as a group?- Table 1 presents the 
frequencies and percentages of inter-rater agreements by 
agreement type across all activities. The square roots of the 
agreement percentages approximate the inter-rater 
correlation (agreement) coefficients (See Kerlinger, 1906). 

As can be seen from Table 1, all three raters agreed that 66 
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of the 114 Instructional activities (57.1*) operationelized the 
characteristic it was constructed to represent. Two of three 
Judges agreed that 108 of 114 instructional activities (94.71) 
operationalized the characteristic they were constructed to 
represent. These percentages translate into an extremely 
conservative lower limit estimate of inter-rater agreement of 
r = +.76 and an upper case estimate of r « +.97. Tht 
percentages of inter-rater agreements show that the raters 
understood the construct of reading evaluatively represented 
by the twenty categories and that they were able to develop 
and Judge the activities well. The percentages of inter-rater 
agreements also showed that the activities fit the categories 
well. 

Table 1: Percentages of Inter-Rater Agreements by Type of 
Agreement Across All Activities. 



Typg of Agreement Frequency Percent Cum. & 

Percent 

1. AH 3 raters agreed 66 57.9 57.9 .76 

2. 2 of 3 raters agreed; 

1 partially agreed 24 21.1 78.9 .89 

3. 2 of 3 raters agreed; 18 15.8 94.7 .97 

1 disagreed 

4. 2 of 3 Judges disagreed, 

or only partially agreed 6 6.2 100 
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As each rater rated 18 activities of the 114 activities, the 
ratings were correlated. Therefore, to take Into account the 
correlation between the rating for the 19 raters, a 19 x 18 
repeated measure ANOVA was used to assess the degree of 
Intra and lnter-rater agreement. As raters could all agree 
with each other but have the "wrong" answer, a deviation 
score between each rating and the "correct" response (I.e., 
yes) was computed so that this relativity was removed from 
the data making the results directly and easily Inter pretable. 

Table 2: One-way Repeated Measures ANOVA for the II Ratings 
of All 19 Judges. 



floucct 
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£_ 
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•judges 


18 


.96 


2.34* 


<.01 


Ratings 


17 


1.07 


2.61* 


<.001 


ERROR 


306 


.41 
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Table 2 presents a one-way repeated measures ANOVA on 
the 18 ratings done by all 19 judges in terms of deviations 
from the "desired or correct" response scores. As can be 
seen from Table 2, significant differences were found between 
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judges (P - 2. 34; df - 17, 906; p«.00i). Post-hoc analyses 
revealed that these differences were due to three judges who 
had a disproportionate number of "Incorrect" responses which 
made these 3 Judges significantly different from the other 16 
Judges in terms of their Judgment correctness and profiles. 
These three Judges simply may have been poor, or'error 
prone" Judges for a number of reasons. First, they may not 
have understood the material presented to them or the rating 
task. Another reason may be that these three Judges may 
have had prior views of literacy and the reading 
comprehension process that interferred with the views and 
model inherent in the materials being rated which produced 
the consistent Judgment errors observed in their 
ratings. Whatever the reason, these three Judges were 
eliminated from the analyses as half or more of their 
ratings were incorrect and the repeated measures ANOVA run 
again. Since only 5 or 6 Judges are needed in validation 
studies of this kind, we still had a sufficient number of 
judges in the reduced analysis to have confidence in the 
generaliaability of our findings and conclusions. 

Table 3 presents the one-way repeated measures ANOVA on 
the 18 ratings done for the remaining 16 Judges. As can be 
seen from Table 3, no significant differences were found 



between Judges or rating patterns for the remaining 16 Judges 
on reanalysls.The F-ratio for Judges fiven in Table 3 converts 
into an inter-rater agreement coefficient of r = +,94 (See 
Kerlinger, 1986). These 16 Judges agreed with each other and 
rated the 18 instructional activities they rated as valid 
operalizatlons of the characteristics they were linked to 
logically. Our 20 characteristics were operationally 
well-defined enough for classroom teachers to construct 
insti uctional activities to be valid exemplars of the 
characteristic by three other classroom teachers. 

Table 3: One-way Repeated Measures ANOVA for the 18 Ratings 
by The Remaining 16 Judges. 



Source di M2_ £ JL 

Judges 15 .26 0.7 >.0F 

Ratings 17 .38 1.6 >.05 

ERROR 255 .38 



A comprehensive table was constructed that summarized 
the number of activities constructed for each characteristic, 
the number of Judges that rated the activities constructed, 



and the rater agreement, for each of the 20 characteristic. 
This tawe is not included her. because of its size and 
unwieldiness. However, the pertinent information from this 
table will be summarised here. As would be seen from the 
table constructed, agreement of all 5 r . Ur9 rang . d from . 
low of 55 .6« to a high of 100* across the 20 characteristics. 
Characteristics 11 (Integrating a Personal View), 
13 (Establishing Goal.), 14 (Detecting Deception), 18 (Developing 
Schema and 19 (Automaticity of Analysis) were the areas of 
Last inter-rater agreement with values ranging from S6.6* to 
66.7*. Characteristics 6 (Beading for Pt. of View), 
9 (Conclusion., Pr.diction.), 15 (Credibility and Validity) and 
20 (Generating Response, to Text) were the area, of highest 
inter-rater agreement with value, ranging from 91.7* to 
100*. Agr. ment of 2 out of 3 judge, ranged from 83.3* to 100* 
for all 20 characteristics. 

When the percentage* of agreement for 2 out of 3 Judges 
•re compared with correct responses, the results 
were still good. Only in on. category, 19 (Automaticity of 
Analysis), doe. the percentage of agreement fall below 70*. 
All of the ratings are based upon the Judgments of 6 activities 
for each category with the exception of two categories. They 
had 4 actitivies each. The number of different Judges rating 
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the activities included in each category ranged from 9 to 14 
suggesting further how well the activities fit the specified 

criterion. 

In general, the results support fhe conclusion that the 
instructional activities created represent the characteristics 
(constructs) well, and that those characteristics can be 
translated, with minimal training, from theoretical constrt is 
(generic characteristics) to instructional activities by 
classroom teachers. However, we do need to explore those 
characteristics where there were difficulties classifying some 
of the activities to determine whether the problem is with 
the construct (characteristic definition) or with the teacher 
who develops end rates the activity. Examining how often 
and why Judges said that an activity did not fit a particular 
category and what other categories it also fit may provide 
some insights concerning these issues when this more 
qualitative data is examined later. 
Conclusions 

The central questions addressed by the present study were 
How well-defined are the 20 proposed characteristics of 
reading evaluatively? and Can each characteristic be 
translated into instruction that logically and validly reflects 
the characteristic? 
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Through the use of * convergent end discriminant validity 
paradigm, the evidence collected warranted a yea answer 
to both questions. The results of the inter-rater 
agreements and the one-way repeated measures ANOVA's 
strongly supported the contention that the 20 characteristics 
can be translated into valid Instructional activities. 

The question of how mutually exclusive the characterisitcs 
are needs to be tested further through other forms of 
analysis. Further examination of the ratings of the judges 
eliminated from the study also may give insight into the 
ability to opt rationalise the construct. 

The findings of this study are an important step in the 
logical validation of the model of reading comprehension and 
the theory of literacy proposed earlier in this paper. 

The results of this study strongly support the view that the 
20 characteristics of the evaluative reader outlined at the 
beginning of this paper ere sufficiently detailed and clear 
enough for classroom teachers to construct valid instructional 
activities which reflect and promote these characteristics in 
students. This finding is important as it means that (1) the 
dissemination of the definitions of the 20 generic 
characteristics given at the beginning of this paper to 
classroom teachers will stimulate the production of 



instructional activities that develop these characteristics 

and (2) classroom teachers may "trade" the 

instructional activities they develop with each other with a 

high degree of confidence that what they "give and take" will 

be valid. This latter knowledge, we believe, is knowledge 

that is important to fostering our different view of literacy 

and reading evaluatively. 

Lastly, it should be noted that many theories and models 

are proposed in the areas of instruction and education. 

However, these theories and models are rarely assessed 

in terms of how easily, reliably, and validly they may 

be transformed into actual instructional activities and 

practices by classroom teachers, which is an important 

characteristic of any theory or model proposed. We have 

experimentally assessed how easily! reliably and validly 

our 20 characteristics of the evaluative reader which are 

derived from our theory of literacy and model of reading 

comprehension can be translated into actual instructional 

activities by practicing classroom teachers. Our results 

were not only excellent but we also have provided and 

field-tested % generic model for assessing the "translatability* 

of theories and models into instructional activities and 

classroom practices. This later point is an additional 

•trtngth and benefit of this study. 
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